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Abstract 

Aloha games study the transmission probabilities of a group of non-cooperative users which share a 
channel to transmit via the slotted Aloha protocol. This paper extends the Aloha games to spatial reuse 
scenarios, and studies the system equilibria and performance. Specifically, fixed point theory and order 
theory are used to prove the existence of Nash Equilibria (NEs), and the existence of a Least Fixed 
Point as the optimal choice of all players. The Krasovskii's method is used to construct a Lyapunov 
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^ . function and obtain the conditions to examine the stability of NEs. Simulations show that the theories 



derived are apphcable to large-scale distributed systems of complicated network topologies. An empirical 
relationship between the network connectivity and the achievable total throughput is finally obtained 
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I. Introduction 

X 

j^ I Game theoretic approaches have been widely used to design multiple access protocols in 

wireless networks. In [HI, the authors provide a comprehensive review of the game models 
developed for different multiple access schemes. In particular, several channel access games in 
ALOHA-like protocols are presented. For example, in [)2l [l3l, MacKenzie and Wicker consider 
the slotted Aloha protocol as a game between users contending for a conventional collision 
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channel where no two or more users are allowed to transmit simultaneously. In their work, 
an infinite users' model is adopted with a finite arrival rate, and all users are assumed to be 
indistinguishable. A strategy in this game is a mapping from the number of backlogged users 
(assumed to be known to all users) to a transmission probability. The authors conclude that, 
for optimal value of the cost parameter, the throughput of a slotted-Aloha system with non- 
cooperative users can be as high as the throughput of a centrally controlled system. This result 
is generalized in flU to show that the same result holds for multi-packet reception (MPR) channels 
that allow more than one packet to be successfully received simultaneously. 

An alternative Aloha game model is proposed by Jin and Kesidis i3, whereby a group of 
heterogeneous users share a conventional collision channel and transmit via slotted Aloha. Each 
user in this game attempts to obtain a target rate by updating its transmission probability in 
response to observed activities. The authors further assume in [|6] that, for users with inelastic 
bandwidth requirements, each user's target rate depends on its utility function and its willingness 
to pay, and they propose a pricing strategy to control the behavior of the users (in order to bring 
their target rates within the feasible region). This Aloha game model is further investigated in [|71- 
flU. In [|71, the authors investigate the effects of altruistic behavior on the stability of equilibrium 
points in a two-player game. In [8], the authors generalize the model and propose a generic 
networking game with applications to circuit- switched networks. In [9|, Menache and Shimkin 
extend the model by incorporating time-varying channel conditions to the channel model. 

The conditions for the existence and stability of the equilibrium solutions have been well 
studied in these works. However, the results of these studies are more suitably applied to the 
uplink random access channel of a centralized system. There also remain fundamental issues 
which are unaddressed. For example, among all equilibrium solutions, does there exist an 
equilibrium point which is optimal to all players, or a solution which always favors different 
subgroups of players? Furthermore, if a global optimal solution does exist for all players, how 
to converge to that equilibrium point during implementation? 

On the other hand, spatial reuse, also known as frequency reuse, is a powerful technique to 
improve the area spectral efficiency of multi-user communication systems. Cellular systems are 
examples whereby radios exploit the power falloff with distance and reuse the same frequency 
for transmission at spatially separated locations [lOJ. Similar ideas can be applied to users in 
a distributed wireless network, where different transmit- receive pairs at a distance away are 



allowed to transmit simultaneously, with the objective to achieve higher system capacity whilst 
still meeting all the transmission quality requirements [iTTIl [fT2ll . In this paper, the Aloha game 
model in [5] is generalized to include spatial reuse capability, named as generalized Aloha 
games. Unlike the model in [5|, the use of spatial reuse here distorts the symmetric structure in 
the expressions to evaluate the NE solution. As a result, a new Lyapunov function needs to be 
constructed to prove the convergence of the generalized Aloha games. 

Also notice that our generalized Aloha games are different from the MPR Aloha game model 
in flU, although they both allow multiple packets to be successfully received simultaneously. 
In im, the users are assumed to be indistinguishable; every user knows the current number 
of backlogged users in the system; the MPR model is possible by enabling multiple captures 
in a single channel, or single capture via the use of multiple parallel channels; the stability 
conditions and stability region of the equilibrium strategy are based on the drift analysis of a 
Markov chain and the selfish behavior of users when the number of backlogged users goes to 
infinity. On the other hand, the generalized Aloha games in this paper assume that users are 
heterogeneous in their Quality-of-Service requirements and their neighboring user environment; 
users have information about the transmission probabilities of others; the MPR capability comes 
from the spatial reuse of a conventional Aloha collision channel; the stability issues are based 
on the Lyapunov stability analysis of a nonlinear system. These differences would be further 
discussed when we introduce the interference matrix in our Aloha game model in Section HIl 

In this paper, we first introduce the model for the generalized Aloha games in Section |Ill 
Then we introduce some mathematical fundamentals on fixed point theory and order theory in 
Section Hill We next discuss the existence of Nash Equilibria (NEs) in Section |lVl In particular, 
we use fixed point theory and order theory to prove the existence of a least fixed point in a 
generalized Aloha game, which is the most energy-efficient equilibrium point for all players. In 
Section |Vl we propose a method to prove the stability of NEs. The Krasovskii's method is used 
to construct the Lyapunov function and obtain the conditions to examine the stability of NEs. 
After obtaining the conditions to test for system stability, we further discuss about the properties 
of NEs. Moreover, we summarize how to dynamically converge to the least fixed point in game 
iterations. Section |Vl] shows through simulations that the generalized Aloha games are applicable 
to large-scale distributed systems with complicated network topologies. An empirical relationship 
between the achievable total throughput and the network connectivity is finally obtained through 



our simulations. We conclude the paper in Section Ivnl 

II. Model for Aloha Games with Spatial Reuse 

Consider a distributed network with A^ transmitters, where each transmitter has its unique 
designated receiver. In Aloha games, each transmit-receive pair is a player who competes for 
the channel to transmit. We assume that every player's transmission queue is continuously 
backlogged, i.e., the transmitter of every player always has a packet to transmit to its designated 
receiver. The objective of the game is for player i to select a suitable transmission probability g^ 
so that player i can achieve its target rate yj, V? G {1, 2, ■ ■ ■ , A^}. The conventional Aloha games 
are generalized to the scenarios where there exists spatial reuse among a group of non-cooperative 
players, i.e., those players who will not interfere each other can transmit concurrently. Here, only 
a connected network is considered (If the network is not connected, then it can be divided into 
several independent connected sub-networks, and then be dealt with separately). As an example, 
three Tx-Rx pairs and their equivalent chain-like topology are shown in Fig. [U where player 
1 and 3 can transmit concurrently without collisions but neither of them can transmit together 
with player 2. Such interference relations can be characterized by an interference matrix A. For 
example, in the chain-like topology given in Fig.l, the interference matrix is given by 
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in which ai2 = 1 means player 2 is a one-hop neighbor of player 1, ais = means player 3 is 
not a one-hop neighbor of player 1, etc. Notice that in this example A is a symmetric matrix. 
However, aij = Uji is not necessarily true, i.e., the interference topology is a directed graph. 

The interference matrix characterizes the spatial distribution and frequency reuse capability of 
the players. Each player has different neighboring players which directly affect its transmission. 
Such specific interference relations between the players cannot be properly described in the form 
of the MPR matrix in dUl. The multi-packet reception (MPR) model in JH is defined by a MPR 
matrix R, whose entries p„fc = [R]nfc is defined as the probability that k packets are successfully 
received in a slot when n packets are transmitted. The MPR matrix is used to characterize the 
MPR model in a probabilistic manner, in which all users are assumed to be indistinguishable 
and have equal chance to transmit successfully. In contrast, the spatial reuse considered in the 



interference matrix is deterministic and specific to each individual player, whose best response 
would then be tailored to its specific neighboring player environment. 

With the defined interference matrix, we can now study the behavior of the generalized Aloha 
games. Assume that player i will choose a new transmission probability gj with the objective to 
achieve the target rate yi, then 

y^ = q^ l[{i -q,),\fte {!,■■■ ,N}. (i) 

aij = l 

The equation indicates that for a successful transmission for player i, all those players which 
will interfere with its transmission (player j where aij = 1), should not transmit. It can be 
seen that the equations obtained here do not have a symmetric structure since the transmission 
probabilities of some of the players are missing in some of the equations, depending on the 
network interference topology. This is unlike the relationship obtained from a fully connected 
network [JS], where aij = 1, Vi ^ j; in this situation, the equations exhibit symmetric structures. 

Interesting questions arise related to the problem. By definition, since all the transmission 
probabilities are real-valued and cannot exceed 1, some of the solutions to ([T]) that do not satisfy 
these constraints should be discarded. Among the remaining solutions, which are also known as 
the NEs of the games, how to examine which of the solutions are stable? In case if there are 
multiple stable NEs, how to make the players reach the consensus to choose the same solution? Is 
there an optimal NE existing among these solutions? Furthermore, suppose the iterative approach 
in Q is applied to ([I]), i.e., the transmission probability of player i at the (m + l)th iteration of 
the game is given by 

gf+^)=min{- ^^__, 1}, V^ 6 {1, ■ ■ ■ , iV}. (2) 
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If NE q* = [ql,q2,- ■ ■ , qh] exists, then from ©, it should satisfy 

^*^ = "^^^Tf TT^T;^' ^>'^^ e {1, ■ ■ ■ , N}. (3) 

iia,,=ii-L qj) 

III. Mathematical Foundation 

In this section, we introduce the Brouwer's fixed-point theorem (in order to prove the existence 
of NEs), the Kleene fixed-point theorem (in order to prove the existence of a least fixed point), 
and some related definitions. These proofs will involve an A^-dimensional vector function F_ = 



(/i) /2, ■ ■ ■ 5 In)'^, whose component fi{q){i G {1, 2, ■ ■ ■ , A^}) is a real-valued function of q E K, 
where K C M^. Besides, one kind of binary relations 'X" between two vectors a,b E K is 
needed, which is defined as component-wise less than or equal to, i.e., a ^ b ^ ai < bi,\/i E 

{i,---,iv}. 

Theorem 1 (Brouwer's fixed-point theorem [fT3l). Every continuous vector function Ffrom a 
convex compact set K (where K C M^j to K itself has a fixed point, i.e., there is a point q E K 
such that F_(q) = q. 

Definition 1. A binary relation over a set K C M^ is a collection of ordered pairs in K. 

Definition 2. A binary relation 'X" over a set K C M^ is a partial order if it is reflexive, 
antisymmetric, and transitive, i.e., Wa,b,c E K, 

(a) reflexivity: a ^ a; 

(b) antisymmetry: if a^b and b^ a, then a = b; 

(c) transitivity: if a^b and b^c, then a^c. 

Definition 3. A subset S of a partially ordered set (K, :<) is called directed if, for any a,bE S, 
there is cE S such that a^c and b^c. 

Definition 4. A partially ordered set (K, :<) is said to be complete, and hence a complete partial 

order, if there is a least element of K (denoted by _Lj and every directed subset S G K has a 
least upper bound sup S E K. 

Definition 5. Let (K, ■<) be a partially ordered set. A vector function F^: K ^ K is monotonic 
or order-preserving if whenever a<b, we have F_{a) ^ Kik)- 

Definition 6. Given a partially ordered set (K, :<), a vector function F : K ^ K is Scott- 
continuous if, for every directed subset S of K, supF(S') = F(sup S) E K. 

Theorem 2 (Kleene fixed-point theorem llT4ll ifTSl ). Let (K, ■<) be a complete partial order, and 
let F : K -^ K be a Scott-continuous vector function. Then F has a least fixed point, which is 
the supremum of the ascending Kleene chain of F. 



The ascending Kleene chain of F_ is the chain 

±^ F(±) ^ F(F(±)) ^ ■ ■ ■ ^ F"(±) ^ ■ • • 

obtained by iterating F_ on the least element ± of K. 
Expressed in a formula, the theorem states that 

LFP(F) = sup F"(±) (4) 

n— >oo 

where LFP denotes the least fixed point, which is less than or equal to all other fixed points of 
F, according to some partial order. 

IV. Equilibria of the generalized Aloha Games 

In this section, we would prove the existence of NEs and a least fixed point in the gen- 
eralized Aloha games. We specify the aforementioned A^-dimensional vector function F_ = 
(/15 /2, ■ ■ ■ ) In)'^, whose component fi is defined as a real function given by 

Mq) = min{= 7^^^' 1}' ^^ e {!,■■■ , N}. (5) 

The function fi maps q = [qi,- ■ ■ , qN] ^ [0, 1]^ into the ith component of the vector function 
F_. The reason to define © will become clearer shortly. 

A. Existence of NEs 

The equations defined in ^ and Brouwer's fixed-point theorem are used to examine the 
existence of NEs. From definition, the fixed point of the vector function F, q* = (g^, q2, ■ ■ ■ , q]^), 
is given by solving F_{q*) = q*, or fi{q*) = qli'^i G {1, ■ " " i^}. By substituting such a 
relationship into ©, it would result in the solution having the same form as that obtained in (|3]). 
This means that the NE solution in ([3]) can be understood as a fixed point to the defined vector 
function F_. Since the continuous vector function F_ maps a point q from the convex compact 
set K = [0, 1]^ to K itself, according to Brouwer's fixed-point theorem, there exists a point q* 
such that q* = F{q*), i.e., ^ follows. 

It is now clear why ^ is defined, as the fixed point behavior of ^ is equivalent to the 
original problem defined in ([T) except that we explicitly include the bound g^ = 1 in (|5]) to 
ensure that F maps into a compact set. One issue to take note is that by using ([5]) to replace 



([U), an extraneous NE point q* = I has been introduced to the original problem. This NE is not 
desirable since all players continuously transmit and all transmissions will result in contention. 
Fortunately, this undesirable NE to the original problem can be easily identified and discarded. 
Since the NEs are proper only if they exist in (0, 1)^, we will focus on such NEs in the 
following discussion. The number of fixed points in (0, 1)^ depends on the interference topology 
and the combination of target rates y = [yi, ■ ■ ■ ,yN]- The following subsection will show that 
if multiple fixed points exist in (0, 1)^, there should exist a most energy-efficient one. 

B. Existence of Least Fixed Point 

In the discussion for generalized Aloha games, the following properties about "^" over the 
set K hold: 

(a) According to Definitions [T] & [2l the binary relation "^" over the set K = [0, 1]^ is a 
partial order, since it is reflexive, antisymmetric, and transitive. 

(b) According to Definitions [3] & IH the partially ordered set (K, <) is a complete partial 
order. The least element of K is given by 0. For every directed subset S d K, the least upper 
bound of S is the largest element in 5, thus sup S E K. Therefore, (K, :<) is a complete partial 
order. 

We are now ready to prove the following propositions. 

Proposition 1. The vector function F_ defined by dJ]) is an order-preserving function over the 
complete partial order (K, :<). 

For any two vectors q,p G K, where q ^ p, we. have 

for i = 1, ■ ■ ■ , A^. According to Definition |51 the proposition holds. 

Proposition 2. For the vector function F_ defined by (O, if there exist multiple fixed points in 
(0,1)^, then a least fixed point exists, which is less than or equal to all other fixed points, 
according to the partial order "^" over the set K. 

According to Definition [6l the vector function F_ defined by dS]) is Scott-continuous, because 
for every directed subset S of K, supF(S') = F(supS') G K, which follows from the order- 
preserving properties of F_. 



In summary, according to Kleene fixed-point theorem, the vector function F_ defined by ([5]) 
has a least fixed point, which is less than or equal to all other fixed points, in the partial order 
"^". Moreover, the least fixed point can be obtained by iterating F_ on the least element of K, 
i.e., 

LFP(F) = sup F"(0). (6) 

n— >oo 

C. Initialization 

Eq.® suggests that the players can choose initial transmission probabilities g*^°) = to reach 
the least fixed point by game iteration. Actually we are able to prove that the initial transmission 
probabilities g'^^) can be set as any point in the set / = [0, yi\ x [0, 1/2] x • ■ ■ [0, Vn], i-C-, 0''-°^ ^ V- 
This can be done using Kleene fixed-point theorem. By replacing K = [0, 1]^ with K' = 
[g| , 1] X [^2 ) 1] X ■ ■ ■ [g]y% 1], one can easily use the earlier approach to show that K' is convex 
and compact, and can verify that {K' , ■<) is a complete partial order. Moreover, from the structure 
of the continuous vector function F_ defined by ([5]), one easily sees that F_{q) h y h q^^^ , therefore 
F_ maps a point q from K' to K' itself. Finally, one can also verify that F^ : K' ^ K' is a 
Scott-continuous vector function. Therefore, by Kleene fixed-point theorem, the least fixed point 
can be obtained by iterating F_ on the least element of K', i.e., 

LFP(F) = sup F"(g(°)),g(°) e I. (7) 

Notice that the actual feasible region for initial transmission probabilities is larger than /. Later 
in Section VI.A we will numerically show that, for a stable NE, there exists a neighborhood Vl 
of this NE such that the system starting from any point in Vl will converge to this NE. However, 
while the values of the NE are not known at the point of evaluating, it might be sufficient to 
look for initial probabilities just from the region /. 

D. Discussion 

The existence of a least fixed point is of great significance. If there exist multiple stable fixed 
points (i.e., NEs) in K, every selfish player will choose the NE which is best for itself. If the 
least fixed point exists, then the transmission probability for every player will be the least at this 
point, thus this NE is the most energy-efficient for every player. As a result, every player will 
choose this NE as the operating point. Finally, we have proved that the players can choose any 
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initial transmission probabilities q^^^ E I to reach the least fixed point by game iteration. These 
results have not been pointed out in the existing work published in [HI [l6]|, where the Aloha 
game model is first brought up. 

On the other hand, (|7]) does not guarantee that such an iteration process is stable, i.e., the 
solution may still diverge due to small disturbance at this fixed point. In the next section, we 
will discuss the method to prove the stability of NEs. 

V. Stability of the Equilibrium Points 

This section investigates the stability of generalized Aloha games defined by the iteration 
process in (|2]). Stability is a desired property of NEs. A stable NE can absorb small disturbances 
within a certain neighborhood Vl, e.g., due to the inaccuracy of estimating other players' trans- 
mission probabilities. On the other hand, if a NE is not stable, then the game iteration process 
will diverge to some undesirable states such as g = 1 or exhibit oscillatory behaviour among a 
few states, which unfortunately leads to network congestion and results in zero throughputs for 
everyone. 

To prove the stability of the resulting NEs, we follow the pattern from flU and approximate 
the generalized slotted Aloha games by the Jacobi update scheme: 

^(m+l) _ ^(m) ^ e(£(gM) _ gM) (8) 

where e is a fixed small positive number and F_ is defined by ([5]). 

For sufficiently small e, ([8]) can be approximated by a continuous -time game: 

m = g_{q{t)) = F{q{t)) - q{t) (9) 

In the presence of spatial reuse, functions defined in (|5]) do not have a symmetric structure 
since the transmission probabilities of some of the players are missing in some of the equations, 
depending on the network interference topology. As a result, the Lyapunov function A{q) in Q 
is no longer applicable to the scenarios with spatial reuse. Therefore, it is necessary to develop 
a more general Lyapunov function to examine the stability of the solutions. 

A. Krasovskii's Method 

We use a new method to construct a Lyapunov function to prove system stability, namely the 
Krasovskii's method II16II. 
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Theorem 3 (Krasovskii's Method). Consider the non-linear system defined by x = g{x), with the 
equilibrium point of interest being the origin. Let J{x) denote the Jacobian matrix of the system, 
i.e., J{x) = dg/dx. If the matrix B{x) = J{x) +j'^{x) is negative definite in a neighborhood Vl, 
then the equilibrium at the origin is asymptotically stable. A Lyapunov function for this system 
is given by A{x) = g^{x)g{x). 

Define C(g) = — B(g) = —[i{q) + i^{q)], where J(g) is the Jacobian matrix of the system 
defined by ^. For those NEs in (0, 1)^, the entries of J(g) can be calculated as follows: 

mh = [dgjd^., = H = 

—1 i = j ( 

J -1 1=2 (10) 

^^j,a,, =0 = < ^^^^^^ 






^ 7^ J) ^i] 



ij^j 



Notice that at an equilibrium point in (0, 1)^, q{t) = g{q{t)) = Z(g(t)) - q{t) = 0, i.e., 



Therefore, the entries of C(g) evaluated at the equilibrium point can be obtained from (|TOl) 
anddlB: 

[c(f)]., = -[J(f) + r(f)]., 

2 z = j (12) 

_aijql _ a jig* ■ , ■ 

An equivalent condition for the positive definiteness of C(g*) is stated in Lemma 1 ifTTll . 

Lemma 1. The real-valued square matrix Cnxn is positive definite if and only if detCi > 
for i = 1,2,- ■ ■ ,N, where Ci is the leading principal sub-matrix of C determined by the first i 
rows and columns. 

Altematively, a sufficient condition for the positive definiteness of C(g*) is that C(g*) be 
diagonally dominant [fTTl . i.e.. 



N 



ttijq* ajiqj 



E(fS + f=^)<2,V.^{l,---,iV}. (13) 

If C(g*) is positive definite, according to the Krasovskii's method, the following proposition 
holds with the corresponding Lyapunov function being A(g) = g^{q)g{q). 
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Proposition 3. If there is an equilibrium point q* G [0, 1]^ with C{q*) being positive definite, 
then there is a neighborhood Q C [0, 1]^ ofq* such that: for any initial transmission probabilities 
q{0) G Q, the function q{t) obeying the dynamics (19]) will converge to q* ^ Vt as t ^ oo. 

For sufficiently small e, the above proposition can be adjusted to make a statement about the 
convergence of ([8]) at the equilibrium point q* . Following the postulation in [[5|, we also postulate 
that the equilibria that are stable for (|9]) are also stable when e=l, i.e., for the original iteration 
©. 

In summary, we can verify the positive definiteness of C(g*) in order to judge the stability 
of the NEs in the generalized Aloha games. Certain necessary and sufficient conditions could 
be used, e.g.. Lemma 1. Altematively, the sufficient condition given in (fT3]) can also be used, 
which is easier to implement and gives almost the same bound. 

B. Choice between Multiple NEs 

First of all, all players would wish to operate at a stable NE and obtain their target rates. 
The price of instability is that the whole network would be congested and nobody can transmit 
successfully. Secondly, the least fixed point would be a focal point in Aloha games, since it is 
the most energy-efficient for every player. Finally, the following proposition suggests that the 
least fixed point is more likely to be stable than other NEs, thus carrying less risk of instability. 

Proposition 4. If the least fixed point is not stable in Aloha games, nor are other fixed points. 

Proof: Let's investigate the entries of C(g*) from (fT2)) first. 

{2 i = j 

a. = \C(q*)]ij = { , a a' (14) 

When i 7^ j, Qj is a non-increasing function of q* in the partial order "^", i.e., if two NEs 
satisfy q* ^ p*, then Cij{q*) > Cij{p*),Wi ^ j. 
Define a function h{x,q*) as follows: 

h{^,Q*) = ^^C(g*)x = ^ 2x'^i + ^ Cij{q*)xiXj, (15) 

where x G M^ is the variable, and q* is a parameter. 
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Now suppose the least fixed point q* is not stable, i.e., C(g*) is not positive definite. According 
to the definition of positive definiteness [fT7l| . 3x 7^ 0, x G M^, such that h(x, q*) < 0. 

Since Qj < 0, Vi 7^ j, we can always find an x with XiXj > 0, Vi 7^ j, such that h{x,q*) < 0. 
For such a given x and any other fixed point p* h q*, we have 

h{x,q*) - h{x,p*) = ^XiXj{cij{q*) - Cij{p*)) > 0. (16) 

Consequently, h{x,p*) < h{x,q*) < 0, i.e., C{p*) is not positive definite. Therefore, if the 
least fixed point is not stable, nor are other fixed points. ■ 

In summary, we only need to focus on the stability of the least fixed point. If it is not stable, 
then no stable equilibrium point exists; if it is stable, then it will be the choice of all players, and 
the behavior of the remaining NEs may not be of our concern since they are not energy efficient 
even if the solution is stable. The reason behind this can be easily interpreted as follows. If 
each player transmits more often but achieves the same throughput, it is just an indication that 
it is likely there are more collisions in the network and hence more likely that the network will 
become congested. 

C. How to Dynamically Converge to Least Fixed Point 

We summarize our results in this subsection. First of all, we construct an interference matrix 
A based on a given distribution of players. Second, for a given combination of target rates 
y = [yi,- ■ ■ ,yN], we can iteratively calculate the least fixed point q* of the vector function F 
defined in © by choosing the initial point q^'^^ E L Third, we judge the stability of the least 
fixed point q* by verifying the positive definiteness of the matrix C(g*) given in (fT2l) . based 
on Proposition [3l Finally, if the least fixed point q* is stable, then all players can arrive at this 
equilibrium point in real game iterations, by choosing any initial point from the set /. 

In short, for a combination of target rates satisfying the stability conditions given by Propo- 
sition [3l all players can reach the least fixed point (i.e., most energy-efficient NE point) as a 
stable operating point, by choosing any initial transmission probabilities q^^^ G /, among which 
and y are two convenient choices. 

VI. Simulation Studies 

In Part A of this section, we first demonstrate the existence of the least fixed point and the use 
of the Krasovskii's method to check its stability by using the three-player chain-like topology. 
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The actual iteration process is simulated so as to test the stability of the NEs predicted by the 
Krasovskii's method. The Region of Attraction (RoA) of the least fixed point is estimated by 
using the Lyapunov function. Then we study the behavior of the fixed points with one varying 
parameter y,;. Moreover, the combinations of maximum achievable target rates for the players are 
plotted. Finally, we give simple illustrations of possible pricing strategies to maximize the sum- 
rate. In Part B, the algorithm developed is then applied to more complicated network topologies. 
We examine the maximum achievable target rates to understand the relationship between the 
spatial reuse capability and the network connectivity. 



A. Three-player Chain-like Topology 

1) Least Fixed Point: We use the three-player chain-like topology in Fig. [Has an illustration. 
Assume yi = y2 = Va = 0.15, then the NEs can be obtained by solving O, which yields 
3 solutions: fe*,?!,?!] = [0.1952, 0.2316, 0.1952], [0.5451, 0.7248, 0.5451], [1.4097, 0.8936, 
1.4097]. Obviously the third solution is not feasible because two of the transmission probabilities 
are greater than 1. The first two solutions are in [0, 1]'^ and are NEs to the game. Denote the 
first solution as NEl and second solution as NE2. It is obvious that NEl ^ NE2. Therefore, 
NEl is the least fixed point. 

2) Krasovskii's Method: The system dynamics is given by: 

Qi = giio) = min{?/i/(l - ga), 1} - Qi 

42 = 92iq) = min{y2/(l - gi)(l - Qs), 1} - q2 (17) 

?3 = g-iiq) = min{y3/(l - ga), 1} - Qs 
The entries of C(g) evaluated at the equilibrium point can be obtained from ([TOl l and (fTT|) : 



C(g*) = -[J(g*)+J^(g*)] = 
2 gi ?2 



1-92 l-9l 

91 _ 12 2 







l-'?2 1-91 





% 



93 



92 93_ 
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(18) 



1-95 1-95 
We now verify NEl and NE2 using the Krasovskii's method by examining whether C( 

given by ([T8l) is positive definite. It can be claimed that NEl is stable while NE2 is not. 
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3) Game Iteration Process: The iteration process of the generalized Aloha Games is given 
by (l2l). To verify the above claim about the stability of NEl and NE2 using the Krasovskii's 
method, set yi = 1/2 = 1/3 = 0.15, set the initial transmission probabilities [q[ , ^2 5 Q's ] equal 
to [^1,^2 7 1/3] (PO), NEl, NE2 separately, and run the game iteration process to see its actual 
performance. 

We see from Fig. |2]that the iteration starting at PO converges to NEl within 10 iterations. On 
the other hand, we also see that the iteration starting at NE2 ends up oscillating between two 
points, [0.1952, 1, 0.1952] and [1, 0.2316, 1]. Therefore, NEl is stable while NE2 is not. This 
is consistent with the previous claim using the Krasovskii's method. 

4) Region of Attraction of the Least Fixed Point: Region of Attraction (RoA) is defined as the 
set of all initial points from which the system will converge to the NE as time goes to infinity 
ifTSl . As was commented in HISII . finding the exact RoA analytically might be difficult or even 
impossible. However, the Lyapunov function can be used to estimate the RoA. From Theorem 
3 and Proposition 3, if the NE is verified to be stable, then the neighborhood Q specified using 
the Krasovskii's method is within the RoA. Therefore, for the three-player chain-like topology 
with yi = y2 = ys = 0.15, we estimate the RoA for the least fixed point (NEl), by verifying 
the positive definiteness of C(g). 

In Fig. [3l the region under the mesh surface provides an estimate of the RoA of NEl. Clearly 
the region / (the cuboid near the origin) defined in Section IIV-CI is within the RoA and can be 
obtained much easier. However, such an estimation is still quite conservative. For the described 
game iteration process, we actually observe that the set of points satisfying q -< NE2 are all 
within the RoA of NEl. 

5) Bifurcation of the Fixed Points: For the three-player chain-like topology, we study here 
the behavior of the fixed points with 1/2 varying, while keeping yi = y^ = 0.15. For different 
values of y2, we solve ([U), and plot the solutions accordingly in Fig. |4] (denote as NE1= q*, 
NE2= p*; the third solution is outside [0, 1]^). 

From Fig. |4] we observe that, as y2 increases from to 0.246, there exist two real-valued 
fixed points q*,p* with q* ■< p* . We verify using the Krasovskii's method that q* is stable 
while p* is not. When ?/2 = 0.246, q* and p* coincide and obtain a critical equilibrium q* = 
[0.3138,0.5223,0.3138], which corresponds to a zero eigenvalue of the Jacobian matrix J{q*). 
If y2 further increases, the fixed points disappear, i.e., there is no real- valued fixed point in 
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[0, 1]'^ (except the extraneous one q* = I introduced by including the bound gj = 1 in ([5])). This 
phenomenon is mathematically named as Fold Bifurcation or Saddle-Node Bifurcation [fT9l . This 
bifurcation is characterized by a single bifurcation condition that the Jacobian matrix J(g*) has 
a codimension-one zero eigenvalue at the critical equilibrium point [|T9ll . 

Similar simulations with yi or y-^ being the varying parameter have been carried out, and we 
observe similar fold bifurcation of the fixed points. Therefore, for the three-player chain-like 
topology, we postulate that at most one stable NE exists and it is the one closest to the origin. 

We also extend the simulations to cases with more players and different topologies. Due to 
computational complexity of calculating all the solutions of ([U), we only examine cases with 
no more than 8 players. We observe three interesting phenomena: (1) there are at most two 
real-valued fixed points in (0, 1)^; (2) these two fixed points exhibit fold bifurcation with any 
of the target rate yi being selected as the varying parameter and the remaining fixed; (3) among 
these two fixed points, the least fixed point is stable while the other is not, before they coincide 
and disappear. However, a rigorous mathematical proof of such bifurcation behavior of the fixed 
points is still difficult, and might require further investigation. 

6) Feasible Region of Target Rates: We compare the maximum achievable target rates between 
a three-player chain-like topology and a fully connected topology (conventional Aloha games). 
We vary the combinations of the players' target rates [l/i, 1/2,1/3] and use the iterative approach 
to evaluate the least fixed point until the stability of this point cannot be achieved. We then plot 
the contour of 1/2 for some given [yi, y^]. 

From Fig. |5l it can be seen that the maximum achievable target rates in three-player chain- 
like topology are larger than those of the fully connected topology. For example, notice that 
[z/i^Z/s] = [0.15,0.15] is below the target rate contour 1/2 = 0.15 of the chain-like topology, 
thus the combination [yi,y2,y3] = [0.15,0.15,0.15] is achievable and a stable NE can be found. 
However, the same combination is not achievable for the fully connected topology. 

7) Maximizing Sum-Rate: Now suppose the three players have chosen [1/1,1/2,1/3] = [0.15,0.15,0.15] 
as their target rates. According to the previous results, they will arrive at a stable operating 
point NE1=[0.1952, 0.2316, 0.1952]. Since the network is not fully loaded, each player can 
probably exploit to transmit at a higher probability to achieve a higher throughput than what is 
originally desired until the network becomes critically stable. The problem becomes a minimum 
rate guarantee model. There are many ways to achieve this and we will get different sum rates 



17 

and fairness for all players. Two direct ways are: (a) each player proportionally increases its 
demand from yi to kyi, where A; > 1. (b) each player proportionally increases its transmission 
probability from q* to bq*, where b>l. The results are summarized in TABLE H] 

This example shows that we can increase the sum rate of all players by a proper pricing 
strategy which guarantees certain criteria of fairness and maintains network stability. Conversely, 
the pricing strategy can also be used to bring the target rates of the players back to the feasible 
region, if the players are over demanding. 

B. Spatial Reuse Gain versus Connectivity 

Consider a distributed network with A^ players, which are randomly placed in a square region 
of a given area. One half of the players will have transmission range of 5 unit length, while the 
other half of players have transmission range of 3 unit length. We assume that all the distances 
between any transmitter and its designated receiver are much smaller than the distances between 
any two transmitters. We further assume that those players who are in each other's transmission 
range will have significant interference on each other, and the two nodes are said to be connected. 
The interference matrix can then be constructed based on the generated network topology. 

1) Performance as Player Density Increases: Player density is defined as the number of 
players per unit area. We first set A^ = 20, and the player density is increased by decreasing the 
spatial area under consideration. 

For each given player density, we run the simulation 100 times. Each time a random topology 
is generated, and for simplicity, we assume that all players have the same target rate. We increase 
this common target rate in steps of 0.001, and run the Krasovskii's method until the least fixed 
point is no longer stable. Consequently, this NE corresponds to the transmission probabilities 
for the players to achieve the maximum target rate. 

Fig. [6] shows that both the average throughput and the average transmission probability of 
the players decrease as the player density increases. The average throughput curve gradually 
approaches the lower limit in which all players are fully connected (which is equivalent to the 
conventional Aloha games). 

2) Performance as Number of Players Increases: In this subsection we fix the player density 
at 0.1, and increase the number of players by increasing the spatial area under consideration. 
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Fig.|7^ shows that the average throughput and transmission probability for the players decrease 
as the number of players increases, for both fully connected network and the generalized Aloha 
games. It can be seen that the average throughput in the generalized Aloha games is significantly 
higher than that in a fully connected network. The achievable average throughput of the fully 
connected network drops below 0.01 when there are more than 40 players. This is comparatively 
low when compared to the generalized Aloha games, whose average throughput stays above 0.04 
even when there are 100 players. We skip the simulation for the fully connected network when 
the number of players is more than 50. 

Fig. Ub shows that the total network throughput for generalized Aloha games increases almost 
linearly as the number of players increases. On the other hand, the total throughput for the fully 
connected network remains at a low level around 0.37. 

3) Relationship between Total Throughput and Connectivity: Define connectivity as the total 
number of links in the current network versus the total number of links in the fully connected case. 
In particular, connectivity equals to 1 in the conventional Aloha games. Connectivity therefore 
serves as an indication of spatial reuse capability. From the above observations, it can be seen 
that if the network is nearly fully connected, i.e., most of the players are within the interference 
range of each other, its throughput resembles to that of a conventional Aloha game. As the 
network connectivity drops, either due to decreased player density or due to a larger spatial 
area compared to the transmission range, the total achievable throughput increases, indicating 
an increased spatial reuse capability. We therefore postulate that there could exist a relationship 
between the reuse capability versus the network connectivity. We will use the data from the 
above two subsections, and present the relationship between total throughput and connectivity. 

Fig. [8] shows that the total network throughput decreases as the connectivity increases, re- 
gardless of the number of players involved. The relationship between total throughput (7) and 
connectivity (X) can be approximated by the following empirical formula: 

0.95*X~o-^7 0.001<X<0.1 

Y={ - (19) 

0.37*X-o-S2 0.1<X<1 

Notice that when connectivity is sufficiently low (below 0.001), the network actually degen- 
erates into several independent connected sub-networks, whose connectivity is higher than the 
original network. In that case, we can apply the above formula separately to each connected 
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sub-network. 

VII. Conclusions and Future Work 

In this paper, we extend the slotted Aloha games to spatial reuse scenarios, namely, generalized 
Aloha games. We use fixed point theory to prove the existence of NEs in generalized Aloha 
games. In particular, we use the Kleene fixed-point theorem to prove the existence of a least 
fixed point, which is the most energy-efficient equilibrium point for all players. We then propose 
to use the Krasovskii's method to prove the stability of NEs. After obtaining the conditions for 
system stability, we further prove that if the least fixed point is not stable, nor are other fixed 
points. These findings ensure the ease in finding the NE of a generalized Aloha game as we only 
need to focus on the least fixed point. If this point is stable, then all players can arrive at this 
equilibrium point through game iteration, by conveniently choosing or y as the initial point. 

We then show through simulation that the theory derived can be applied to large-scale dis- 
tributed systems with complicated network topologies to study the maximum achievable through- 
put. An empirical relationship between the network connectivity and the achievable total through- 
put is finally obtained through simulations. 

Pricing strategies are required to bring the target rates within the feasible region. This paper 
has not yet addressed pricing issues for generalized Aloha games, despite the simple illustration 
via the example of the three-player chain-like topology. Future work could be the design of 
pricing or negotiating strategies among the players in a distributed manner to bring the target 
rates within the feasible region, or more desirably, toward an optimal combination of target rates 
which maximizes the total throughput of all players given certain fairness criteria. 
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f^max or Umax 


y 


<?* 


^y^ 


original demand 


1 


[0.15,0.15,0.15] 


[0.1952,0.2316,0.1952] 


0.45 


y^ky 


1.27 


[0.1905,0.1905,0.1905] 


[0.3336,0.4290,0.3336] 


0.5715 


q* -^ bq* 


1.94 


[0.2086,0.1734,0.2086] 


[0.3787,0.4493,0.3787] 


0.5905 



TABLE I: Maximizing sum-rate by proper pricing strategies 




n 




Fig. 1: 3 transmit-receive pairs 
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Fig. 2: Game iteration process 
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Fig. 3: Estimation of RoA for NEl 
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Bifurcation of Fixed Points (y2 is the varying parameter, y1=y3=0.15) 




V'l 

P2 

Ml I III I ?5 

V2 



0.25 



0.3 



Fig. 4: Bifurcation of Fixed Points (?/2 is the varying parameter, yi = ys = 0.15) 
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Fig. 5: Maximum achievable target rate contours 
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Network Performance as Player Density Increases 
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Fig. 6: No. of players = 20, decrease spatial area 



Performance as No. of Players Increases 
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Fig. 7: Player density = 0.1, increase spatial area 
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Relationship between Total Througfiput and Connectivity 
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Fig. 8: Relationship between total throughput and connectivity 



